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ABSTRACT 



A study examined the performance of the High Schools That 
Work (HSTW) initiative in 1996 and 1998, based on data from the HSTW 
Assessments. Analyses found support for the hypothesis that HSTW is the cause 
of school improvement, although other non-measured factors may also influence 
these schools, and showed that between 1996-98 HSTW schools significantly 
increased percentages of students in their senior classes who met the HSTW 
achievement goals in mathematics, science, and reading and who completed the 
HSTW- recommended program of study. Evidence indicated many HSTW practices 
were being implemented and supported the hypothesis that meeting the HSTW 
curricular standards is related to meeting the achievement goals. Increases 
in the use of best instructional practices, in vocational teachers' 
emphasizing using academic skills for vocational assignments, in the amount 
of time students spend on homework, and in the percentages of students who 
receive help from the school in developing a four-year educational plan were 
related to an increase in percentage of students ' meeting achievement goals . 
Analyses showed schools that had an increase in percentage of students who 
took a mathematics or science course in senior year had an increase in 
percentage of students completing the HSTW curriculum in those academic 
areas. Teacher indicators are appended. (Contains 10 figures and 13 tables.) 
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INTRODUCTION 



Founded by the Southern Regional Education Board (SREB) in 1987, High Schools That 
Work (HSTW) is a comprehensive school-reform initiative that combines challenging academic courses 
and modem career/technical studies to raise the achievement of career-bound high school students 
(Bottoms, 2000). Career-bound students are the 60 to 65 percent of high school youths who plan to 
work, attend a two-year technical or community college, enroll in a four-year college or university with 
an open admission policy or enter the military after high school graduation. The initiative’s goal is to 
improve the communication, mathematics, science, technical and problem-solving skills of career-bound 
youths. 



HSTW is built on the belief that students following general and career/technical programs of 
study can master complex academic and technical concepts if schools create an environment that 
encourages students to make the effort to succeed (Bottoms, 2000). HSTW focuses special attention 
on career-bound youths because these students have not had access to a rigorous academic curriculum 
(SREB, 1998). HSTWs intent is to increase the achievement of these students to prepare them for 
further learning or careers. 

The HSTW framework brings together school and district leaders, teachers, students, families, 
and community and state leaders in a collaborative effort to create a more challenging and meaningful 
high school program of study (SREB, 1998). HSTW articulates actions to improve student achievement 
and provides technical assistance to assist schools in developing and carrying out a school improvement 
plan. The actions that guide schools are: 

B Set clear whole-school goals aimed at improving student achievement. 

1 Use the HSTW framework of key practices to create a vision of school improvement. 

1 Participate in the HSTW Assessment. 

1 Create a structure for involving staff, students, parents and business leaders in continuous 
planning to improve student learning. 
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1 Obtain support from district and school leaders to make quality instruction and support for 
teachers a priority by providing extensive staff development, time for teachers to work and 
plan together, and resources to implement change (SREB, 1998). 

The HSTW initiative began in 1987 with 28 schools; it now includes more than 1,100 schools in 
26 states. It is one of the initiatives listed in a report from the Northwest Regional Educational 
Laboratory (NREL) on the Comprehensive School Reform Demonstration program, which provides 
funds for states to use in grants to local school districts to implement school-reform programs (NREL, 
2000). Unlike many school-reform programs, HSTW has shown evidence of successful outcomes for 
students. In a research report that examined 24 major school-reform programs, HSTW was one of only 
three programs that had strong evidence of positive effects on student achievement and one of only 
12 programs that provided strong support to schools (American Institutes for Research, 1999). 



HSTW Initiative 



To assist schools in developing an educational environment that affirms the ability of all students 
to leam high-level academic and technical concepts, HSTW suggests a recommended program of study 
and key practices for accelerating student achievement. HSTW recommends replacing the general- 
education track, which HSTW developers believe fails to prepare students adequately for work or 
further education (Bottoms, 2000). The U.S. Department of Education (1994) reports that students in 
the general track of most high schools do not meet the typical college-entry requirements, nor do they 
complete an adequate number of credits in a specific vocational labor market. Career-bound students 
in HSTW are expected to meet both of these challenges. The /TSTIE-recommended courses blend the 
essential content of college-preparatory mathematics, science and language arts courses with modem 
career/technical studies in grades nine through 12 (Bottoms, 2000). The /TSrff-recommended 
curriculum consists of: 

R At least four credits in English courses with the content and performance standards of 
college-preparatory English; 
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I At least three credits in mathematics, including two credits in courses with the content and 
performance standards of college-preparatory Algebra I, geometry, Algebra II and 
trigonometry; 

8 At least three credits in science, including two credits in courses with the content and 
performance standards of college-preparatory biology, chemistry, physics or applied 
physics; and 

1 At least four credits in an academic or a career/technical major. 

In addition to completing an upgraded academic core, career-bound students “major” in either 
a broad technical field of study or further academic studies. By requiring students to earn four credits in 
a concentration, high schools hold students to higher intellectual and technical standards in that area. 

The U.S. Department of Education (1994) reports that vocational education students who concentrate 
their vocational education in one area and find jobs related to their training have higher earnings than 
those who take lower-level courses in multiple areas. 

HSTW also recommends 10 key practices that schools should implement to accelerate student 
achievement. The practices include having high expectations for all students, giving all students access to 
intellectually challenging academic and career/technical studies, engaging students in their studies, and 
giv ing students extra help with their schoolwork..(See Table 1.) By implementing the key practices, 
schools should be able to increase the number of students taking the recommended courses and 
improve student achievement. 

HSTWs aim is to improve student achievement. Every two years, HSTW schools administer 
the HSTW Assessment, which is based on the National Assessment of Educational Progress (NAEP). 
In these assessments, seniors in HSTW schools take hour-long achievement tests in mathematics, 
science and reading. The HSTW performance goals are scores of 295 in mathematics, 292 in science 
and 279 in reading. Schools in the HSTW network also administer surveys to students and teachers to 
ask about their educational/teaching experiences. 
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Table 1. High Schools That Work’s 10 Key Practices 



Key Practices 



High Expectations : Set higher expectations and get career-bound students to meet them. 



Vocational Studies: Increase access to challenging vocational and technical studies, with a major 
emphasis on using high-level skills in the context of modem workplace practices and in preparation for 
continued learning. 



Academic Studies: Increase access to academic studies that teach the essential concepts from the 
college-preparatory curriculum by encouraging students to use academic content and skills to address 
real-world projects and problems. 



Program of Study: Have students complete a challenging program of study with an upgraded 
academic core that includes four years of college-preparatory English and three years each of 
mathematics and science (at least two years in each area equivalent to college-preparatory courses). 



Work-based Learning: Give students and their parents the choice of a system that integrates school- 
based and work-based learning. The system should span high school and postsecondary studies and 
should be planned by educators, employers and employees. 



Teachers Working Together Implement an organizational structure that provides academic and 
vocational teachers the time to plan and provide integrated instruction aimed at teaching high-level 
academic and technical content. 



Students Actively Engaged: Get every student involved in rigorous and challenging learning. 



Guidance: Involve each student and his or her parents in a guidance and advising system. 



Extra Help: Provide a structured system of extra help to enable students who may lack adequate 
preparation to complete an accelerated program of study that includes high-level academic and 
technical content. 



Keeping Score : Use student assessment and program evaluation data to improve continuously the 
school climate, organization, management, curricula and instruction to advance student learning and to 
recognize students who meet both curriculum and performance goals. 



After participating in the assessment, each school receives a report that contains the school’s 
results from the current and previous assessments. These reports enable school staff to chart their 
progress in improving the academic and technical performance of students. School leaders and staff use 
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the assessment information in revising instruction, graduation requirements, curricula, guidance 
practices, extra-help systems and work-based learning programs (Bottoms, 2000). The reports contain 
information on students’ scores on the achievement tests and course-taking patterns, as well as 
students’ responses to individual survey items. The reports also contain group scores that enable a 
school to compare its results to other groups, such as 1) students at high-scoring schools that are 
demographically similar to the school, 2) students at all high-scoring HSTW sites, 3) students in the 
NAEP national vocational sample, and 4) students in the NAEP national sample of college-preparatory 
students (Bottoms, 2000). 

Conceptual Model 

In this study we are interested in two measures of student achievement: 1) the percentage of 
students who meet HSTWs goals on the NAEP-based achievement tests in mathematics, science and 
reading, and 2) the percentage of students who complete HSTW s rigorous program of study. (See 
Figure 1 .) Increasing the number of students who meet the goals on these tests is a major aim of 
HSTW. We hypothesize that the second measure of achievement, the percentage of students who 
complete HSTW s rigorous program of study, will affect the first measure of achievement, performance 
on achievement tests, as shown in the conceptual model. Theoretically, students who complete the 
rigorous program of study will have higher performance on the achievement tests than those who do 
not. (This hypothesis is tested in this paper.) 

Figure 1. Conceptual Model 
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Our conceptual model depicts the manner in which we hypothesize that the HSTW model 
affects schools and students. We propose that schools’ higher levels of implementation of the HSTW 
key practices will lead directly to more students’ meeting the HSTW standards on the achievement 
tests. In addition, we propose that implementation of the HSTW key practices will also lead indirectly to 
more students’ meeting the HSTW standards on the achievement tests through an effect on the 
percentage of students that complete the //S7TF-recommended program of study. If the model is 
effective in the way it is supposed to be, we should find the proposed relationships. 

Research Questions 

The purpose of this report is to examine the performance of the HSTW initiative in 1996 and 
1998, based on data from the HSTW Assessments in these years. We asked these specific questions: 

I What was the level of student achievement in HSTW schools in 1996? 

1 Were there changes in student achievement between 1996 and 1998? 

1 What was the level of implementation of the key practices in 1996? 

I Were there changes in the level of implementation of the key practices between 1 996 and 
1998? 

I What was the relationship between implementation of the key practices and student 
achievement? 

Overview of the Study 

We conducted analyses using HSTW's assessment data for 1996 and 1998 to examine the 
effects of participation in HSTW on schools and students. The assessment data were originally collected 
with the intent of providing specific information to individual schools, not with the intent of studying the 
HSTW initiative as a whole. However, we believe that these data can be useful to create a basic picture 
of the HSTW initiative and to address the research questions listed above. This report and similar 
research are especially important due to the small amount of research in the area of comprehensive 
school reform. While there is substantial literature on theories of school reform, there is a need for 
research on the effectiveness of specific reform approaches. 
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To confirm whether HSTW's key practices existed in schools, we examined representative 
indicators to assess the initiative’s implementation level in schools. In addition, we examined the effect 
of this implementation on student achievement. However, all of the key practices are not represented in 
this study because the assessment data does not fully represent all of the key practices. 

Thus, we were only able to find indicators measuring seven of the 10 key practices. (See Table 
2.) These measures by no means represent all aspects of a key practice - only those that were readily 
available from the assessment data. 



Table 2. Key Practices with Representative Indicators from the Surveys 



Key Practices 


Measures (Source) 


High Expectations: Set higher 
expectations and get career-bound 
students to meet them. 


» School Expectations for Vocational Students (teacher 
survey) 

• Importance Placed on Encouraging Student Success 
(teacher survey) 

9 Supportive Instructional Environment (teacher survey) 


Vocational Studies: Increase 
access to challenging vocational and 
technical studies, with a major 
emphasis on using high-level skills in 
the context of modem workplace 
practices and in preparation for 
continued learning. 


® Vocational Teachers Stress Academic Skills (student 
survey) 

• Vocational Teachers Emphasize Using Academic Skills for 
Vocational Assignments (student survey) 

® Administrators’ Expectations that Vocational Teachers 
Will Integrate Academics into Their Classes (teacher 
survey) 


Academic Studies: Increase access 
to academic studies that teach the 
essential concepts from the college- 
preparatory curriculum by 
encouraging students to use 
academic content and skills to 
address real-world projects and 
problems. 


® Use of Best Instructional Practices in Mathematics 
Courses (student survey) 

• Use of Best Instructional Practices in Science Courses 
(student survey) 

• Use of Best Instructional Practices in English Courses 
(student survey) 

9 Teacher Emphasis on Basic Learning Skills (teacher 
survey) 

• Use of Mathematics in an Applied Context (student 
survey) 

® Use of Science in an Applied Context (student survey) 
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Key Practices 


Measures (Source) 


Program of Study: Have students 
complete a challenging program of 
study with an upgraded academic 
core that includes four years of 
college-preparatory English and three 
years each of mathematics and 
science (at least two years in each 
area equivalent to college- 
preparatory courses). 


0 Percentage of Students Who Completed the HSTW 
Program of Study in Mathematics, Science and English 
(student survey) 

• Percentage of Students Who Took Mathematics in Their 
Senior Year of High School (student survey) 

• Percentage of Students Who Took Science in Their Senior 
Year of High School (student survey) 


Teachers Working Together: 
Implement an organizational structure 
that provides academic and 
vocational teachers the time to plan 
and provide integrated instruction 
aimed at teaching high-level 
academic and technical content. 


• Academic and Vocational Teachers Meet as a Team 
(teacher survey) 


Students Actively Engaged: Get 
every student involved in rigorous and 
challenging learning. 


® Increase in Use of Best Instructional Practices Since 
Beginning HSTW (teacher survey) 

® Amount of Time Students Spend on Homework Each Day 
(student survey) 


Guidance: Involve each student and 
his or her parents in a guidance and 
advising system. 


• Percentage of Students Who Receive Help from Their 
School in Developing a Four- Year Educational Plan 
(student survey) 



METHODS 



Data 

High Schools That Work schools gather data for the student assessment and program 
evaluation through the HSTW Assessment every two years. The assessment consists of three 
components: 1) a student survey for career-bound students; 2) a teacher survey; and 3) student 
achievement tests in mathematics, science and reading. The student survey focuses on high school 
academic and vocational classroom experiences, course-taking patterns, and work experiences of 
career-bound students. Students participate in the assessment as seniors; to be eligible, they must have 
completed at least four credits in a planned sequence of vocational courses. The teacher survey 
includes questions on school climate, expectations for students, teacher efficacy, students’ skills, 
changes since the school joined HSTW, and teachers’ use of time. 

Students take hour-long NAEP-based achievement tests in mathematics, science and reading. 
HSTW has established performance goals for students in these three areas, along with an explanation of 
skills that are indicated by meeting each goal. The test score for the mathematics goal indicates that 
students can apply their understanding of mathematical operations and notation to interpret expressions 
and solve a variety of problems, including some multi-step problems in algebra and geometry. It also 
indicates that students can to read and use instruments, interpret data from a variety of graphs, and find 
the probability of a simple event. The test score for the science goal indicates that students can interpret 
the results of science experiments and can determine the appropriateness of an experimental design. It 
also indicates that students can demonstrate an understanding of key principles from the physical and 
life sciences; apply knowledge, skills and reasoning abilities to interpret scientific and technical data 
from simple tables; and make inferences about results of experimental procedures. The test score for 
the reading goal indicates that students can demonstrate an overall understanding and interpretation of 
what they read; make connections between what they read and their personal experiences and draw 
conclusions; and use information to perform tasks and follow directions (Bottoms, 2000). 

For some analyses we divided the schools into two groups: 1) new HSTW schools and 2) 
experienced HSTW schools. New HSTW schools completed their first HSTW assessment in 1996, 
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while experienced HSTW schools completed their first HSTW assessment in 1994 or earlier. 

Compared with experienced schools, new schools might show more change in between 1996 and 1998 
because, unlike new schools, experienced schools may have fully or partially implemented many of the 
key practices by the time of the 1996 assessment. 

Sample 



Of the total number of schools participating in HSTW, 393 schools collected student and 
teacher data as part of the HSTW Assessments in both 1996 and 1998. We used the data from these 
schools in our analyses. These data represent the responses of 18,373 students in 1996 and 19,244 
students in 1998 and 14,363 teachers in 1996 and 14,685 teachers in 1998. (See Table 3.) 1 About 30 
percent of the students in these schools were non-white and about 80 percent had parents who had 
completed at least a high school education. (See Table 4.) The majority of teachers were female and 
white; at least half of them had earned a master’s degree or higher. (See Table 5.) 

Table 3. Number of Participants in the Sub-sample of Schools that Participated 



in HSTW in Both 1996 and 1998 





1996 


1998 


Number of students 


18,373 


19,244 


Number of teachers 


14,363 


14,685 



Table 4. Characteristics of Students in the Sub-sample of Schools that Participated 



in HSTW in Both 1996 and 1998 





1996 


1998 


Percentage of female students 


52 


52 


Percentage of non-white students 


30 


29 


Percentage of mothers with a high school education or higher 


80 


82 


Percentage of fathers with a high school education or higher 


77 


79 



'This study is not longitudinal, so the students who participated in the study in 1996 are not the same students who 
participated in the study in 1 998. Some of the same teachers may have participated in the study in both years, but since the 
study does not track individual participants, we do not know the number of teachers who participated in both years. 
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Table 5. Characteristics of Teachers in the Sub-sample of Schools that Participated in HSTW 
in Both 1996 and 1998 





1996 


1998 


Percentage of academic teachers (versus vocational 
teachers) 


68 


70 


Percentage of female teachers 


61 


62 


Percentage of teachers over age 40 


63 


63 


Percentage of non-white teachers 


18 


18 


Percentage of teachers with a master’s degree or higher 


54 


52 



Analyses 

Our analysis of data from the biennial assessment involves indicators that represent many 
aspects of the HSTW key practices. These indicators include data gathered from both the teacher and 
the student surveys. Some indicators consist of student or teacher responses to a single survey question. 
Other indicators consist of multi-item scales that include student or teacher responses to several survey 
questions. We used multi-item scales instead of individual questions (where possible) as a data 
reduction technique in these analyses, since many questions in each survey represent a similar aspect of 
the same key practice. Each multi-item scale combines information from several questions that 
represent similar information. We then assessed each scale for internal consistency: If a scale has a high 
internal consistency score, respondents tended to answer these questions similarly. (See Appendix A 
for a list of the individual items and the multi-item scales.) Individual survey questions that had low 
internal consistency with a multi-item scale were deleted from that scale. We divided one multi-item 
scale — school climate - into two sub-scales for ease of presentation and interpretation. These two sub- 
scales were used separately for all analyses except for the final regression analyses, which used the 
overall school climate scale. After scale creation, the individual student and teacher data were 
aggregated into school-level data. All analyses were conducted at the school level. All analyses used 
either teacher or student data, but no analyses included both data sets. 

The questions from the student and teacher surveys measure specific aspects of some of the 
key practices, but not the entire key practice. Therefore, throughout the rest of this paper we will refer 
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to both the individual survey questions and the multi-item scales that we use as “indicators,” since they 
each represent only one aspect of one of the HSTW key practices. The following list shows the seven 
indicators that we used from the teacher survey. (We note whether each is an individual item or a multi- 
item scale.) 

I School Expectations for Vocational Students (individual item); 

H Importance Placed on Encouraging Student Success (multi-item scale); 

I Supportive Instructional Environment (multi-item scale); 

1 Administrators’ Expectations that Vocational Teachers Will Integrate Academics into Their 
Classes (multi-item scale); 

I Teacher Emphasis on Basic Learning Skills (multi-item scale); 

B Academic and Vocational Teachers Meet as a Team (individual item); and 
i Increase in Use of Best Instructional Practices Since Beginning HSTW (multi-item scale). 

The next list shows the 11 indicators that we used from the student survey. (We note whether 
each is an individual item or a multi-item scale.) 

I Vocational Teachers Stress Academic Skills (multi-item scale); 

I Vocational Teachers Emphasize Using Academic Skills for \focational Assignments (multi- 
item scale); 

8 Use of Best Instructional Practices in Mathematics Courses (multi-item scale); 

1 Use of Best Instructional Practices in Science Courses (multi-item scale); 

8 Use of Best Instructional Practices in English Courses (multi-item scale); 

8 Use of Mathematics in an Applied Context (individual item); 

8 Use of Science in an Applied Context (individual item); 

8 Percentage of Students Who Took a Mathematics Course in Their Senior Year of High 
School (individual item); 

8 Percentage of Students Who Took a Science Course in Their Senior Year of High School 
(individual item); 

1 Amount of Time Students Spend on Homework Each Day (individual item); and 

1 Percentage of Students Who Receive Help from Their School in Developing a Four-Year 
Educational Plan (individual item). 
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To answer the research questions, we examined changes in student achievement as well as 
changes in school practices. We used paired t-tests to determine whether student achievement 
(achievement test scores and course-taking patterns) changed significantly from 1996 to 1998. We also 
used paired t-tests to compare the levels of program implementation in 1996 and 1998. Finally, we 
tested our causal hypotheses regarding the influence of changes in implementation of the HSTW key 
practices on changes in student achievement (test scores and course-taking patterns) using multi-variate 
linear regression. 



RESULTS AND DISCUSSION 



The results of our analyses are organized by the research questions. 

What Was the Level of Student Achievement in HSTW Schools in 1996? 

What percentages of students met the HSTW achievement goals on the NAEP-based 
tests in 1996 and 1998? In 1996, 48 percent of the students met the HSTW goal for the mathematics 
achievement test, 51 percent for the science achievement test, and 42 percent for the reading 
achievement test. (See Table 6.) In 1998, 59 percent of the students met the HSTW goal for the 
mathematics achievement test, 55 percent for the science achievement test, and 50 percent for the 
reading achievement test. The HSTW goal is to have 85 percent of students meet the achievement 
goals. 

Table 6. Percentages of Students Who Met HSTW * s Goals on the NAEP-Based 
Achievement Tests in 1996 and 1998 



NAEP-Based Test 


1996 


1998 


Mathematics (N = 392) 


48% 


59% 


Science (N = 392) 


51% 


55% ! 


Reading (N = 392) 


42% 


50% 



What percentages of students completed the //STJP-recommended program of study in 
1996 and 1998? In 1996, 64 percent of students met the HSTW standard for a rigorous program of 
study in mathematics, 37 percent for a rigorous program of study in science, and 32 percent for a 
rigorous program of study in English. (See Table 7.) In 1998, 79 percent of students met the HSTW 
standard for a rigorous program of study in mathematics, 51 percent for a rigorous program of study in 
science, and 38 percent for a rigorous program of study in English. Students were most likely to 
complete the program of study in mathematics, followed by science and then English. The HSTW goal 
is to have all students complete a rigorous program of study. 
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Table 7. Percentages of Students Who Met HSTW s Program of Study in 1996 and 1998 



Recommended Program of Study 


1996 


1998 


Mathematics (N = 390) 


64% 


79% 


Science (N = 389) 


37% 


51% 


English (N = 389) 


32% 


38% 



Were There Changes in Student Achievement Between 1996 and 1998? 

What were the changes in the percentages of students who met the HSTW 
achievement goals on the NAEP-based tests between 1996 and 1998? For mathematics, science 
and reading, a significantly higher percentage of students met HSTW s achievement goals in 1998 
compared with 1996. 2 An average of 11 percent more students per school met the mathematics goal; 
an average of four percent more students per school met the science goal; and an average of eight 
percent more students per school met the reading goal. These results show that schools in the HSTW 
network are successfully increasing the number of students who meet the HSTW goals (although this 
type of analysis cannot determine whether this increase is related to participation in HSTW or to other 
factors). 

What changes occurred between 1996 and 1998 in the percentage of students who 
completed the HSTW program of study? The second measure of student achievement is completion 
of a rigorous program of study. For all three academic subjects, a significantly higher percentage of 
students completed HSTWs program of study in 1998 compared with 1996. 3 In mathematics an 
average of 15 percent more students per school completed the program of study; in science an average 
of 14 percent more students per school completed the program of study; and in English an average of 6 
percent more students per school completed the program of study. These results show that schools in 
the HSTW network successfully increased the number of students who completed the HSTW program 



2 These differences were all significant at the p < .00 1 level. These differences also existed when new and experienced sites 
were analyzed separately (at the p < .01 level). 

3 These differences were all significant at the p < .001 level. These differences also existed when new and experienced sites 
were analyzed separately (at the p < .05 level). 
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of study (although this type of analysis cannot determine whether this increase is related to participation 
in HSTW or to other factors). 

Key points on student achievement. At this point, we have covered the first two research 
questions of this report: 1) What was the level of student achievement in HSTW schools in 1996 and 2) 
Were there changes over time in student achievement? The results show that between 40 and 60 
percent of students met the HSTW achievement goals on the NAEP-based tests in 1996 and 1998, 
compared with the goal of having 85 percent of students meet these goals. Over the two-year period 
there were significant increases in the percentage of students who met the NAEP-based test goals in all 
three academic areas. There was an especially large increase (11 percent) in the area of mathematics. 

In terms of the HSTW program of study, a fairly high percentage of students met the goal in 
mathematics (64 to 79 percent), with more moderate percentages of students meeting the goal in 
science (37 to 5 1 percent) and English (32 to 38 percent). Over the two-year period HSTW schools 
showed increases in the percentages of students who completed the recommended program of study, 
with especially large increases in mathematics (15 percent) and science (14 percent). 

What Was the Level of Implementation of the Indicators in 1996? 

What was the level of implementation of the indicators of the key practices for new 
HSTW sites in 1996? To answer this question we used data from the teacher and student surveys to 
examine the degree to which schools were able to implement some indicators of the HSTW key 
practices. For these analyses, we separated new and experienced schools. We expect experienced 
schools to have higher levels of implementation of the indicators compared with new schools, because 
the new schools have had less time to implement these indicators. 

According to teacher surveys, where did new HSTW schools stand on the indicators in 
1996? The average levels of implementation reported for new schools in 1996 showed that about the 
time schools entered the HSTW program they met the goals or were close to meeting the goals for three 
of the seven indicators measured from the teacher survey. (See Table 8.) Experienced HSTW schools 
met the goals for the same three indicators. Teachers in new HSTW schools reported:: 



i Practices that encourage student success were more than important (M= 3.32 on a 1- 
4 scale where 3, the goal, represents important). Experienced schools had an average 
of 3.35. 

1 They agree somewhat that their school engages in practices that create a supportive 
instructional environment (M = 2.97 on a 1-4 scale where 3, the goal, represents agree 
somewhat). Experienced schools had an average of 3.06. 

1 They emphasize basic learning skills often (M = 2.99 on a 1-4 scale where 3, the goal, 
represents often). Experienced schools had an average of 3.05. 



Table 8. Teacher Reports on Levels of Implementation of Indicators in HSTW Schools in 
1996 



Indicators from Teacher Surveys 
(Higher Score = Better Implementation. See Appendix A.) 


New Sites 
1996 

(N = 223) 


Experienced 
Sites 1996 
(N = 170) 


Goal 


School Expectations for Vocational Students 


2.08 


2.15 


3 


Importance Placed on Encouraging Student Success 


3.32 


3.35 


3 or higher 


Supportive Instructional Environment 


2.97 


3.06 


3 or higher 


Administrators’ Expectations that Vocational Teachers Will 
Integrate Academics in Their Classes 


2.82 4 


3.02 5 


4 


Teacher Emphasis on Basic Learning Skills 


2.99 


3.05 


3 or higher 


Academic and Vocational Teachers Meet as a Team 


2.05 


2.10 


4 or higher 


Increase in Use of Best Instructional Practices Since 
Beginning HSTW 


3.41 


3.53 


4 or higher 



However, as Table 8 also shows, both new and experienced HSTW schools fell short of the 
goals on four of the indicators in 1996. For these indicators, teachers in new HSTW schools reported: 

1 Their school did not expect vocational students to meet the same academic standards 
as college-preparatory students (M = 2.08 on a 1-3 scale where 3, the goal, represents 
expecting vocational students to meet the same standards in academics that are 
expected of students planning to directly enter a four-year college, and a score of 2 
represents that the school only expects vocational students to master the academic 
content needed for further study in a work or educational setting). The average for 
experienced schools was 2.15. 



4 N = 220 

5 N = 169 
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i School administrators expected vocational teachers to integrate academics into their 
classes to some extent 6 (M = 2.82 on a 1-4 scale where 3 represents to some extent 
and 4, the goal, represents a great deal). Experienced schools had an average of 3.02. 

1 Academic and vocational teachers met about once a year to plan collaborative 

instructional activities (M= 2.05 on a 1-5 scale where 2 represents once this year and 
4 or higher, the goal, represents once per week). Experienced schools had an average 
of2.10. 

1 Schools had not met the goal for increasing their use of best instructional practices since 
becoming HSTW sites (M= 3.41, on a 1-5 scale where 3 represents no change and 
the goal is 4 or higher). Experienced schools had an average of 3.53. 

Thus, the results show that while schools were implementing three of the seven indicators at or 
close to the goal levels in 1996, increased implementation was needed for the four remaining indicators. 

According to student surveys, where did schools stand on the indicators in 1996? The 
average levels of implementation of the indicators reported by students reveal that both new and 
experienced schools had not yet met the goals for any of these indicators, although they were close to 
meeting the goals for some of them. (See Table 9.) The results showed other student indicators that 
needed higher levels of implementation. Specifically, in new schools: 

I Vocational teachers stressed academic skills more than seldom (M = 2.29 on a 1-3 
scale where 2 represents seldom stressed and 3, the goal, represents often). 
Experienced schools had an average of2.31. 

1 Vocational teachers emphasized using academic skills to complete vocational 

assignments less than monthly or several times a year (M = 2.78 on a 1-4 point scale 
where 3 represents required monthly or several times a year and 4, the goal, 
represents required daily or weekly). Experienced schools had an average of 2.85. 

I Mathematics teachers used an average of 2.45 out of 7 best instructional practices 
frequently enough, where the goal is to use 4 best instructional practices frequently 
enough. (Mathematics teachers in experienced schools used an average of 2.56 
instructional practices frequently enough.) 7 



6 This question was asked of vocational teachers only. 

7 The goal for mathematics is to use 4 out of 7 instructional practices frequently enough. 
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